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COMPLEMENTARY  PIVOT  THEORY  OP  MATHEMATICAL  PROCRAM  INC 


by 


Richard  W.  Cottle  and  Caorga  B.  Dantzlg 


1.  Formulation.  Linear  programing,  quadratic  programing,  and 

bimatrix  (tvo-peraon,  non  zero-sum)  games  lead  to  the  conalderatlon 

of  the  following  Fundamental  Problem:  Given  a  real  p-vector  q 

and  a  real  pxp  matrix  M,  find  vectora  w  and  z  which 

* 

eatisfy  the  conditions 


(1) 

w  ■  q  +  Mz, 

w  >,  0,  i>0 

(2) 

o 

• 

» 

N 

The  remainder  of  thla  section  Is  devoted  to  an  explanation  of  why 
this  Is  so.  (There  are  oth::r  fields  In  which  this  fundamental 
problem  arises  —  see  frr  example  (6)  and  [13]  —  but  we  do  not  treat 
them  here.)  Sections  2  and  3  are  concerned  with  constructive 
procedures  for  solving  the  fundamental  problem  under  various  assumptions 
on  the  data  q  and  M. 


In  general,  capital  roman  letters  denote  matrices  while  vectors  are 
denoted  by  lower  case  roman  letters.  Whether  a  vector  is  a  row  or 
a  column  will  always  be  clear  from  the  context,  and  consequently  we 
dispense  with  transpose  signs  on  vectors.  In  (2),  for  example, 
zw  represents  the  scalar  product  of  z(row)  and  w(column).  The 
superscript  T  indicates  the  transpose  of  the  matrix  to  which  it  is 
affixed. 
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Consider  first  linear  programs  in  ths  sysssatric  primal-dual  form 


dua  to  J.  von  Nausuinn  (20). 

Primal  linear  proaraa:  Find  a  vector  x  and  minimum  z  such  that 

(3)  Ax  ^  b,  x  ^  0,  *  •  cx 

Dual  linear  program:  Find  a  vector  y  and  maximum  jt  such  that 

(4)  yA  L  c»  y  2.  0*  £  ■  yb 

The  duality  theorem  of  linear  programming  (3)  etatea  that 
min  z  -  max  z_  when  the  primal  and  dual  syateme  (3)  and  (4), 

i 

respectively,  are  consistent  or  —  in  mathematical  programming 
parlance  —  "feasible."  Since 

i  ■  yb  <.  yAx  cx  ■  z 

for  all  primal-feasible  x  and  dual-feasible  y,  one  seeks  such 
solutions  for  which 

(5)  yb  -  cx 

The  inequality  constraints  of  the  primal  and  dual  problems 
can  be  converted  to  equivalent  systems  of  equations  in  non-negative 
variables  through  the  introduction  of  non-negative  "slack"  variables. 
Jointly,  the  systems  (3)  and  (4)  are  equivalent  to 

(6)  Ax  -  v  -  b,  v  >,  0,  x  >.  0 

T 

A  y  +  u  ■  c,  u  2,  0,  y  >.  0 


2 


... 


— ♦ 

i  :  i  *.v  .agK  . 


\ 


and  the  linear  programming  problem  becomes  one  of  finding  vectors 
u,  v,  x,  y  such  that 


u  i  0,  v  >  0 


x  >.  0,  y  >,  0 


(8) 


xu  +  yv  -  0 


The  definitions 


establish  the  correspondence  between  (1),  (2)  and  (3),  (4). 

The  quadratic  programming  problem  is  typically  stated  in  the 
following  manner:  Find  a  vector  x  and  minimum  z  such  that 


(10)  Ax  2,  b  ,  x  >.  0  ,  z  ■  cx  +  — j-jcDx 

In  this  formulation,  the  matrix  D  may  be  assumed  to  be  symmetric. 

The  minimand  z  is  a  globally  convex  function  of  x  if  and  only  if 
the  quadratic  form  xDx  (or  matrix  0)  is  positive  semi-definite, 
and  when  this  is  the  case,  (10)  is  called  the  convex  quadratic 
programming  problem.  It  is  immediate  that  when  D  is  the  zero  matrix, 
(10)  reduces  to  the  linear  program  (3).  In  this  sense,  the  linear 
programming  problem  is  a  special  case  of  the  quadratic  programming 


problem. 


For  any  quadratic  programming  problam  (10),  dafina  u  and  v 


by 

(ID 

T  * 

u  «  Dx  ■  A  y  +  c,  v  ■  Ax  -  b 

A  vector  x° 

yields  minimum  z  only  if  there  exists  a  vector 

and  vectors 

u°,  v°  given  by  (11)  for  x  »  x°  satisfying 

(12) 

x°  i  0,  u°  *,  0,  y°  _>  0,  v°  >,  0 

o  o  n  o  o  . 

x  u  ■  0  ,  y  v  ■  0 


Theae  nacaaaary  conditions  for  a  minimum  In  (10)  arc  a  direct 
consequence  of  a  theorem  of  H.  W.  Kuhn  and  A.  W.  Tucker  [14].  It  la 
well  known  —  and  not  difficult  to  prove  from  firat  principles  — 
that  (12),  known  as  the  Kuhn-Tucker  conditions,  are  also  sufficient 
in  the  case  of  convex  quadratic  programming.  By  direct  substitution, 
we  have  for  any  feasible  vector  x, 

z  -  r°  •  c(x  -  x°)  +  -j-xDx - j-x°Dx° 

-  u°(x  -  x°)  +  y°(v  -  v°)  +  -y-(x  -  x°)D(x  -  x°) 

-  u°x  +  y°v  +  -|-(x  -  x°)D(x  -  x°)  _>  0 

which  proves  the  sufficiency  of  conditions  (12)  for  a  minimum  in  the 
convex  case. 

Thus,  the  problem  of  solving  a  quadratic  program  leads  to  a 
search  for  solution  of  the  system 
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(13)  u  ■  Djc  -  A*y  ♦  c  *  ^  0,  y  i  0 

v  ■  Ax  -b  u  i  0,  v  _>  0 

(14)  xu  +  yv  -  0 
The  definitions 

(15)  v  - 

establish  (13),  (14)  ss  s  problem  of  the  form  (1),  (2). 

Duel  of  s  convex  quadratic  program.  From  (15)  one  is  led  naturally 
to  the  consideration  of  a  matrix  M  ■  j  wherein  B  ,  Ilka  D  , 

Is  positive  seal-definite.  It  is  shown  in  [1]  that  the 
Primal  quadratic  program:  Find  x  and  minimum  z  such  that 

(16)  Ax  +  Ey  >,  b,  x  ^  0,  z  -  cx  +  -~-(xDx  +  yEy) 
has  the  associated 

Dual  quadratic  program:  Find  y  and  maximum  z.  such  that 

(17)  -Dx  +  A^y  <.  c  ,  y  0  ,  _z  ■  by - y-  (xDx  -  yEy) 

All  the  results  of  duality  In  linear  programming  extend  to  these 
problems,  and  indeed  they  are  jointly  solvable  if  either  is  solvable. 
When  E  ■  0,  the  primal  problem  is  just  (10)  for  which  W.  S.  Dorn 
[5]  first  established  the  duality  theory  later  extended  In  [1].  When 
both  D  and  E  are  zero  matrices,  this  dual  pair  (16),  (17) 

reduces  to  the  dual  pair  of  linear  programs  (3),  (4). 


5 


t  ■ 


I 


k 

-  \ _ < 


*s 


UhAIKS.  (a)  The  alnlaand  in  (10)  &•  strictly  convex  if  and  only 

If  tha  quadratic  fora  xDx  la  positive  definite.  Any  feasible  strictly 
convex  quadratic  program  has  a  unique  minimising  solution  x°. 

(b)  When  D  and  E  are  positive  seal-definite  (the  case  of 
convex  quadratic  progressing) ,  so  la 


A  blaatrlx  (or  two-person  nontero-aua)  ease.  r(A,B),  la  given  by 
a  pair  of  axn  aatricea  A  and  B  One  party,  called  the  row 
play*  r.  has  a  pure  strategies  which  are  identified  with  the  rows 
of  A  .  The  other  party,  called  the  ryitiMy  player,  has  n  pure 
strategies  which  correspond  to  the  coluane  of  B  .  If  the  row  player 
uses  his  it]»  pure  strategy  end  the  coluan  player  uses  hie  1th 
pure  strategy,  then  their  respective  loeeea  are  defined  aa  a, .  and 
b^  ,  respectively.  Using  mixed  strategies 

a 

x  -  (x. ...  «x  )  >,  0,  l  x  -  1 
1  "  1-1  1 

n 

y  ■  (yi . yn>  i  o»  l  y*  ■  1 

j-i  J 

their  expected  losses  are  xAy  end  xBy,  respectively.  (A  component 
In  s  mixed  strategy  is  Interpreted  as  the  probability  with  which  the 
player  uses  the  corresponding  pure  strategy.) 

A  pair  (x°,yC)  of  mixed  strategies  is  a  Nash  [19]  equilibrium 
point  of  r(A,B)  if 
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»  A' 


x°Ay°  ^  xAy°  all  mixed  strategies  x 

x°By°  ^  x°By  all  mixed  strategies  y 

It  la  avldant  (aaa  for  axaapla  115))  that  if  (x°,y°)  la  an 
equilibrium  point  of  r(A,B),  than  it  la  alao  an  equilibrium  point 
for  tha  game  F(A'  B')  In  which 

A'  -  [ai  +  K]  .  B'  -  [b^  +  L) 

whara  K  and  L  ara  arbitrary  acalara.  Hanca  thara  la  no  loaa  of 
ganarallty  In  aaaualng  that  A  >  0  and  B  >  0,  and  va  ahall  make  thla 
assumption  haraaftar. 

Next,  by  latting  a^  danota  tha  k-vector  all  of  whoaa  components 
are  unity,  it  la  easily  shown  that  (x°,y°)  la  an  equlllbrluai  point 
of  r(A.B)  If  and  only  If 


»-» 

00 

(x°Ay°)e  <,  Ay° 

P 

(A  >  0) 

(19) 

,  0_  0.  ,  ,1  o 

(x  By  )e  <  B  x 
n 

(B  >  0) 

This 

characterization  of  an  equilibrium  point  leads  to  a  theorem 

which 

relates  the  equilibrium-point  problem  to  a  system  of  tha  form 

(1). 

(2).  For  A  >  0  and  B  >  0, 

*  *  *  * 

If  u  ,v  ,x  ,y  is  a  solution 

of  the  system 

(20) 

i 

£ 

■ 

9 

u>0,  y  2.  0 

T 

v  ■  B  x  -  e 

v  >  0,  x  >  0 

n 
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(21) 


xu  ♦  yv  ■  0 


then 


,oo. 

(*  .y  ) 


x 

* 

x  e 


* 

y  e 


n 


!•  an  equilibrium  point  of  r(A,B).  Conversely,  if  (x°,y°)  is  an 
equilibrium  point  of  r(A,B)  then 


*  A 

<x  .y  ) 


Oa  O  0.0 

x  By  x  Ay 


la  a  aolutlon  of  (20),  (21)  .  The  latter  system  is  clearly  of  the 

form  (1),  (2),  where 

'0  A' 


w  •  I  ,  q 

L  v  j 


-e 


m 


-e 


M  -  |  I  ,  z 

B  0 


(;) 


Notice  that  the  assumption  A  •» 0,  B  s  0  precludes  the  possibility 
of  the  matrix  M  above  belonging  to  the  positive  semi-def inlte  class. 

The  existence  of  an  equilibrium  point  for  r(A,B)  was 
established  by  J.  Nash  [19]  whose  proof  employs  the  Brouwer  Fixed- 
Point  Theorem.  Recently,  an  elementary  constructive  proof  was 
discovered  by  C.  E.  Lemke  and  J.  T.  Howson,  Jr.  [15]. 

2 .  Lemke' s  iterative  solution  of  the  fundamental  problem.  This 
section  is  concerned  with  the  iterative  technique  of  Lemke  and  Howson 
for  finding  equilibrium  points  of  bimatrix  games  which  was  later 
extended  by  Lemke  to  the  fundamental  problem  (1),  (2).  We  Introduce 
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first  sons  terminology  common  to  ths  subject  of  this  section  end  the 
next.  Consider  th«  system  of  linesr  equations 

(22)  w  ■  q  +  Ms 

where,  for  the  moment,  the  p-vector  q  end  the  p  x  p  matrix  M 
are  arbitrary.  Both  w  and  z  are  p-vectors. 

For  i  -  l,...,p  the  corresponding  variables  and  w^  are 
called  complementary  and  each  is  the  complement  of  the  other.  A 
complementary  solution  of  (22)  is  a  pair  of  vectors  satisfying 

(22)  and 

(23)  z^  -  0  ,  i  -  l,...,p 

Notice  that  a  solution  (w;z)  of  (1),  (2)  is  a  nonnegative 

complementary  solution  of  (22).  Finally,  a  solution  of  (22)  will 
be  called  almost-complementarv  if  it  satisfies  (23)  except  for  one 
value  of  i,  say  i  -  B.  That  is,  z^  +  0,  Wg  j*  0* 

In  general,  the  procedure  assumes  as  given  an  extreme  point  of 
the  convex  set 

Z  ■  ^z  |  w  ■  q  +  Mz  >.  0,  z  _>  0 

which  also  happens  to  be  the  endpoint  of  an  almost-complementary 
ray  (unbounded  edge)  of  Z.  Each  point  of  this  ray  satisfies  (23) 
but  for  one  value  of  i,  say  B.  It  is  not  always  easy  to  find  such 
a  starting  point  for  an  arbitrary  M.  Yet  there  are  two  important 
realizations  of  the  fundamental  problem  which  can  be  so  initiated. 


The  first  is  the  bimatrix  game  case  to  be  discussed  soon;  the  second  is 
the  case  where  au  entire  column  of  M  is  positive.  The  latter  property 
can  always  be  artif ically  induced  by  augmenting  M  with  an  additional 
positive  column;  as  we  shall  see,  this  turns  out  to  be  a  useful  device 
for  initiating  the  procedure  with  a  general  M. 

Each  Iteration  corresponds  to  motion  from  an  extreme  point 
along  an  edge  of  Z  all  points  of  which  are  almost-complementary 
solutions  of  (22).  If  this  edge  is  bounded,  an  adjacent  extreme 
point  P^+1  is  reached  which  is  either  complementary  or  almost- 
complementary.  The  process  terminates  if  (i)  the  edge  is  unbounded 
(a  ray),  (ii)  is  a  previously  generated  extreme  point,  or 

(iii)  pi+i  is  a  complementary  extreme  point. 

Under  the  assumption  of  nondegeneracy,  the  extreme  points  of  Z 
are  in  one-to-one  correspondence  with  the  basic  feasible  solutions  of 

(22)  (See  (3)  ).  Still  under  this  assumption,  a  complementary  basic 
feasible  solution  is  one  in  which  the  complement  of  each  basic 
variable  is  nonbasic.  The  goal  is  to  obtain  a  basic  feasible  solution 
with  such  a  property.  In  an  almost-complementary  basic  feasible  of 

(23) ,  there  will  be  exactly  one  index,  say  6  ,  such  that  both 

Wg  and  Zg  are  basic  variables.  Likewise,  there  will  be  exactly  one 

* 

index,  say  v  ,  such  that  both  w  and  z  are  nonbasic  variables  . 

')  v 

* 

C.  van  de  Panne  and  A.  Whinston  [21]  have  used  the  appropriate 
terms  basic  and  nonbasic  pair  for  / w_  .  z_l  and  fw  .  z  1 

rsapecH^Ty.  '*  ei  V  v  "J 
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An  almost-complementary  edge  is  generated  by  holding  all  nonbasic 
variables  at  value  zero  and  increasing  either  zy  or  of  the 

nonbasic  pair  ,  wy  .  There  are  consequently  exactly  two  almost- 

complementary  edges  associated  with  an  almost-complementary  extreme 
point  (corresponding  to  an  almost-complementary  basic  feasible 
solution) . 

Suppose  that  z^  is  the  nonbasic  variable  to  be  Increased.  The 
values  of  the  basic  variables  will  change  linearly  with  the  changes 
in  .  For  sufficiently  small  positive  values  of  z^,  the 

almost-complementary  solution  remains  feasible.  This  is  a  consequence 
of  the  nondegeneracy  assumption.  But  in  order  to  retain  feasibility, 
the  values  of  the  basic  variables  must  be  prevented  from  becoming 
negative. 

If  the  value  of  zy  can  be  made  arbitrarily  large  without 
forcing  any  basic  variable  to  become  negative,  then  a  ray  is  generated. 
In  this  event,  the  process  terminates.  However,  if  some  basic 
variable  blocks  the  increase  of  zy  (i.e.  vanishes  for  a  positive 

value  of  z  ),  then  a  new  basic  solution  is  obtained  which  is 

v 

either  complementary  or  almost-complementary.  A  complementary 
solution  occurs  only  if  a  member  of  the  basic  pair  blocks  zy  . 

A  new  almost-complementary  extreme  point  solution  is  obtained  if  the 
blocking  occurs  otherwise.  In  the  complementary  case,  we  have  the 
desired  result:  a  complementary  basic  feasible  solution.  In  the 
almost-complementary  case,  the  nondegeneracy  assumption  guarantees 
the  uniqueness  of  the  blocking  variable.  It  will  become  nonbasic  in 
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place  of  and  its  index  becomes  the  new  value  of  v  . 

The  complementary  rule.  The  complement  of  the  (now  nonbasic)  blocking 
variable  --  or  equivalently  put,  the  other  member  of  the  "new" 
nonbasic  pair  —  is  the  next  nonbasic  variable  to  be  increased.  The 
procedure  consists  of  the  iteration  of  these  steps.  The  generated 
sequence  of  almost-complementary  extreme  points  and  edges  is  called 
an  almost-complementary  path. 

THEOREM  1.  Along  an  almost-complementary  path,  the  only  almost- 
complementary  basic  feasible  solution  which  can  re-occur  is  the 
initial  one. 

PROOF:  We  assume  that  all  basic  feasible  solutions  of  (22)  are 
nondegenerate.  (This  can  be  assured  by  any  of  the  standard 
lexicographic  techniques  [3]  for  resolving  the  ambiguities  of 
degeneracy.)  Suppose,  contrary  to  the  assertion  of  the  theorem, 
that  the  procedure  generates  a  sequence  of  almost-complementary 
basic  feasible  solutions  in  which  a  term  other  than  the  first  one 
(PQ  in  the  figure  below)  is  repeated  (say  P^) .  By  the  nondegeneracy 
assumption,  the  extreme  points  of  Z  are  in  one-one  correspondence 
with  basic  feasible  solutions  of  (22).  Let  denote  the  successor 

of  and  let  P^  denote  the  second  predecessor  to  P^  namely 

the  one  along  the  path  just  before  the  return  to  P^. 
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The  extreme  points  Po,P2,P^  are  distinct  and  each  is  adjacent  to 
along  an  almost-complementary  edge.  But  there  are  only  two  such 
edges  at  P^.  This  contradiction  completes  the  proof. 

We  can  immediately  state  the 

COROLLARY.  If  the  almost-complementary  path  is  initiated  at  the 
endpoint  of  an  almost-complementary  ray,  the  procedure  must  terminate 
either  in  a  different  ray  or  a  complementary  basic  feasible  solution. 

It  if]  easy  to  show  by  examples  that  starting  from  an  almost- 
complementary  basic  feasible  solution  which  is  not  the  endpoint  of 
an  almost-complementary  ray,  the  procedure  can  return  to  the  initial 
point  regardless  of  the  existence  or  non-existence  of  a  solution  to 
(1),  (2). 

EXAMPLE  1.  The  set  Z  associated  with 


is  nonempty  and  bounded.  It  is  clear  that  no  solution  of  (1)  can 
also  satisfy  (2)  since  z^w^’O.  Let  the  extreme  point 
corresponding  to  the  solution  w  -  (1,0,0),  z  -  (1,0,2)  be  the 
initial  point  of  a  path  which  begins  by  increasing  Z£.  This  will 
return  to  the  initial  extreme  point  after  4  iterations. 

EXAMPLE  2.  The  set  Z  associated  with 


) 


S/v « >*#>0 


/  > 
l 

f° 

0 

0 

oN 

-l 

1 

0 

0 

1 

q  - 

3 

,  M  - 

-1 

-1 

-1 

-1 

0 

0 

0 

-l, 

is  likewise  nonempty  and  bounded.  The  corresponding  fundamental 
problem  (1),  (2)  has  a  complementary  solution  w  -  (1,0, 1,0), 

z  ■  (0,1, 0,1).  Yet  by  starting  at  w  -  (1,2, 0,1),  z  -  (3, 0,0,0)  and 
increasing  Zy  the  method  generates  a  path  which  returns  to  its 
starting  point  after  4  iterations. 

Furthermore,  even  if  the  procedure  is  initiated  from  an  extreme 
point  at  the  end  of  an  almost-complementary  ray,  termination  in  a  ray 
is  possible  whether  or  not  the  fundamental  problem  has  a  solution. 
EXAMPLE  3.  Given  the  data 


/  \ 

(  \ 

1 

0  0  0  1 

-1 

t 

10  0  1 

3 

M  - 

•H 

1 

1 

H 

1 

/ 

1 

o 

o 

o 

the  point  of  Z  corresponding  to  w  «  (1,0,A,1),  z  *  (1,0, 0,0)  is 
at  the  end  of  an  almost-complementary  ray,  w  ■  (1,W2»A  +  w^.l), 
z  *  (1  +  w^, 0,0,0).  Moving  along  the  edge  generated  by  increasing 
z^  leads  to  a  new  almost-complementary  extreme  point  at  which  the 
required  increase  of  z^  is  unblocked,  so  that  the  process  terminates 
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In  a  ray,  and  yet  the  fundamental  probelm  la  solved  by 
w  -  (2, 0,1,0),  z  -  (0,1, 0,1). 

EXAMPLE  4.  In  the  problem  with 


f  1  1 

1° 

0\ 

q  - 

I 

» 

M  - 

1-1  1 

\l 

-li 

the  inequalities  (1) 

have 

solutions 

,  but  none 

of 

them  satisfy 

(2). 

The  point  corresponding  to 

(w;z)  - 

(1,0;1,0) 

is 

at  the  end  of 

an 

almost-complementary 

ray 

w 

*  (l»w2), 

z  -  (w2, 

0). 

When  z2  is 

increased,  it  is  not  blocked,  and  the  process  terminates  in  a  ray. 
Consequences  of  termination  in  a  ray.  In  this  geometrical  approach 
to  the  fundamental  problem,  it  is  useful  to  interpret  algebraically 
the  meaning  of  termination  in  an  almost-complementary  ray.  This  can 
be  achieved  by  use  of  a  standard  result  in  linear  inequality  theory 
[11],  [3]. 

*  * 

LEMMA.  If  (w  ;z  )  is  an  almost-complementary  basic  feasible 

*  * 

solution  of  (22),  and  (w  ;z  )  is  incident  to  an  almost-complementary 
ray,  there  exist  p-vectors  w^,z^  such  that 

(24)  w*1  *  Mz*1,  w*1  _  0,  z*1  >  0,  z*1  +  0 

and  points  along  the  almost-complementary  ray  are  of  the  form 

(25)  (w  +  Aw*1  ,  z  +  Az*1)  A  ^  0 
and  satisfy 


(26)  (w^  +  Aw^) (z  +  Az^)  -  0  for  all  A  ^  0,  and  all  1^6 

THEOREM  2.  If  M  >  0,  (22)  has  a  complementary  basic  feasible 

solution  for  any  vector  q. 

PROOF.  Select  w^,...,  as  the  basic  variables  in  (22).  We  may 
assume  that  q  ^  0  for  otherwise  (w;z)  ■  (q ; 0)  immediately  solves 
the  problem.  A  starting  ray  of  feasible  almost-complementary 
solutions  is  generated  by  taking  a  sufficiently  large  value  of 
any  nonbaslc  variable,  say  z^.  Reduce  z^  toward  zero  until  it 
reaches  a  value  z°  _>  0  at  which  a  unique  basic  variable  (assuming 
non-degeneracy)  becomes  zero.  An  extreme  point  has  then  been 
reached . 

The  procedure  has  been  initiated  in  the  manner  described  by  the 
corollary  above,  and  consequently  the  procedure  must  terminate  either 
in  a  complementary  basic  feasible  solution  or  in  an  almost- 
complementary  ray  after  some  basic  feasible  solution  (w;z*)  is 
reached.  We  now  show  that  the  latter  cannot  happen.  For  if  it  does, 
conditions  (24)  -  (26)  of  the  lemma  obtain  with  8  ■  1.  Since 

i.  i 

M  '  0  and  z  _  0,  this  implies  wn  ■>  0.  Hence  by  (26), 

*  h 

Zi  "  zi  ”  ^  ^or  Hence  the  only  variables  which  change 

with  A  are  z^  and  the  components  of  w.  Therefore  the  final 
generated  ray  is  the  same  as  the  initiating  ray,  which  contradicts  the 
corollary. 

THEOREM  3.  A  bimatrix  game  r(A,B)  has  an  extreme  equilibrium  point. 
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PROOF.  Initiate  the  algorithm  by  choosing  the  smallest  positive 


value  of  x^,  say  x^,  such  that 


(27) 


T  n 

v  -  -  e  +B.x,  >0 
n  11  — 


T  T 

where  is  the  first  column  of  B  .  With 


o  .  dT  o 

v  -  -  e  +  B.x, 
n  11 


it  follows  (assuming  nondegeneracy)  that  v  has  exactly  one  zero 
component,  say  the  r-th.  The  ray  is  generated  by  choosing  as  basic 
variables  x^  and  all  the  slack  variables  u,v  except  for  vf. 

The  complement  of  v^,  namely  y^,  is  chosen  as  the  nonbasic 
variable  to  increase  indefinitely.  For  sufficiently  large  values  of 
yr>  the  basic  variables  are  all  nonnegative  and  the  ray  so  generated 
is  complementary  except  possibly  x^u^  might  not  equal  0.  Letting 
y^  decrease  toward  zero,  the  initial  extreme  point  is  obtained  for 
some  positive  value  of  y^ . 

If  the  procedure  does  not  terminate  in  an  equilibrium  point,  then 

by  the  corollary,  it  terminates  in  an  almost-complementary  ray.  The 

latter  implies  the  existence  of  a  class  of  almost-complementary 

* 

solutions  of  the  form 


(28) 


*  .  .  h\ 
u  +  \u 

*  .  h  i 
V  +  Xv 


-e 


m 


-e 


T 

B  0 


x  +  Xx 

*  h 

y  +  Ayn 


The  notational  analogy  with  the  previously  studied  case  M  >  0  is 
obvious. 
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(29) 


all  i  i  1 


(uj  +  Au^)(x*  +  Ax^)  -  0 


all  A  >  0 


(30)  (v*  +  AvJ)  ( y *  +  AyJ  )  -  0  all  j  ( 

Assume  first  that  x*1  +  0.  Then  v*1  ■  BTx**  >  0.  By  (30), 

y^  +  Ay^  »  0  for  all  j  and  all  A  >_  0.  But  then  u  +  Auh  ■  -e^  <  0, 

a  contradiction.  Assume  next  that  y*1  i  0  and  x*1  -  0.  Then 

u*1  ■  Ay*1  >  0.  By  (29) ,  x^  ■  0  for  all  i  i  1;  and  x^  ■  0  for 
h  T  h  * 

all  i.  Hence  v  ■  B  x  *0  and  v  is  the  same  as  v  defined  by 

(27)  since  x^  must  be  at  the  smallest  value  in  order  that 
*  *  *  * 

(u  ,v  ,x  ,y  )  be  an  extreme-point  solution.  By  the  nondegeneracy 

assumption,  only  -  0,  and  v*  >  0  for  all  .1  ^  r.  Hence  (30) 

*  h 

implies  y^  +  Ay^  ■  0  for  all  j  r  r.  It  is  now  clear  that  the 
postulated  terminating  ray  is  the  original  ray.  This  furnishes  the 
desired  contradiction.  The  algorithm  must  terminate  in  an  equilibrium 
point  of  the  bimatrlx  game  r(A,B). 

A  modification  of  almost-complementarv  basic  sets.  Consider  the 
system  of  equations 


(31)  w-q+ez  +Mz 

P  ° 

where  zq  represents  an  "artifical  variable"  a-.id  e^  is  a  p-vector 

(1 . 1).  It  is  clear  that  (31)  always  has  nonnegative  solutions. 

A  solution  of  (31)  is  called  almost-complementarv  if 

.  w  *  0  for  i  ■  l,...,p  and  is  complementary  if.  in  addition, 

z  -  0.  (See  [16,  p.  685]  where  a  different  but  equivalent 
o 
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T 


f 


7t> 

*  ,  W.V-  ' 

/  y 


definition  is  given.)  In  this  case,  let 


■  /  (z  ,z)  I  w  »  q  +  e  z  +  Mz  ’  0,  z  >  0,  z  ^  0  } 

t  o  p  o  0“  ' 


We  consider  the  almost-complementary  ray  generated  by  sufficiently 
large  zq.  The  variables  are  initially  basic  while 

Zo’zl’*’*,Zp  are  nonbasic  variables.  For  a  sufficiently  large  value 


of  z  ,  say  z  , 
o  o 


+  + 
w  ■  q  +■  e  z  >0 
p  o 


As  z  decreases  toward  zero,  the  basic  variables  w.  decrease.  An 
o  i 

initial  extreme  point  is  reached  when  z  attains  the  minimum  value 

o 

z°  for  which  w  -  q  +  e  z  *  0.  If  z°  ■  0,  then  q  >  0;  this 
o  npo—  o*  n  — 

is  the  trivial  case  for  which  no  algorithm  is  required.  If 

z°  ■>  0,  some  unique  basic  variable,  say  wf  has  reached  its  lower 

bound  0.  Then  z  becomes  a  basic  variable  in  place  of  w  and 
o  r  r 

we  have  v  -  r.  Next,  z r,  the  complement  of  wr,  is  to  be 
increased . 

The  remaining  steps  of  the  procedure  are  now  identical  to  those 

in  the  preceding  algorithm.  After  a  blocking  variable  becomes  basic, 

its  complement  is  increased  until  either  a  basic  variable  blocks 

the  increase  (by  attaining  its  lower  bound  0)  or  else  an  almost- 

complementary  ray  is  generated.  There  are  precisely  two  forms  of 

termination.  One  is  in  a  ray  as  just  described;  the  other  is  in  the 

reduction  of  z  to  the  value  0  and  hence  the  attainment  of  a 
o 

complementary  basic  feasible  solution  of  (31),  i.e.  a  solution  of 
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(1),  (2). 

Interest  now  centers  on  the  meaning  of  termination  in  an  almost- 
cooplementary  ray  solution  of  (31).  For  certain  classes  of  matrices. 
the  process  described  above  terminates  in  an  almost-complementary 
ray  if  and  only  if  the  original  system  (1)  has  no  solution.  In  the 
remainder  of  this  section,  we  shall  amplify  the  preceding  statement. 

If  termination  in  an  almost-complementary  ray  occurs  after  the 

*  *  * 

process  reach.es  a  basic  feasible  solution  (w  ;zq,z  )  corresponding 

to  an  extreme  point  of  Zq,  then  there  exists  a  nonzero  vector 
,  h  h  h. 

(w  ;zqIz  )  sucli  that. 

. n v  h  h  ,  h  ,  h  h  h.  .. 

(32)  w  ■  e^Zo  +  Mz  ,  (w  ^  0 

Moreover  for  every  a  0  , 

(33) 

*  h  *  h  *  h 

(w  +  Aw  )  ■  q  +  e  (z  +  Az  )  +  M(z  +  Az  ) 

p  o  o 

and 

(34)  (wi  +  Az^)(zi  +  Az^)  -  0  i  ■  l,...,p  . 

The  case  zh  -  0  is  ruled  out,  for  otherwise  z*1  >  0  and  then 

o 

w*1  ■  0  because  (w^;z^,z^)  ^  0.  Now  if  w*1  >  0,  (34)  implies 

*  h  * 

z  +  iz  ■  z  "0.  This,  in  turn,  implies  that  the  ray  is  the 
original  one  which  is  not  possible. 

Furthermore,  it  follows  from  the  almost-complementarity  of 
solutions  along  the  ray  that 
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.1 


J 

I 

1 

1 

I 

l 

J 

1 


/<lc,  *  *  *  h  h  *  hh  n  .  . 

(35)  z^w  ^  ■  ziwi  “  ziwi  “  ziWi  "  ®  i  ■  . 

The  individual  equations  of  the  system  (32)  are  of  the  form 

(36)  wi  “  Zo  +  i  *  1 . .  • 

Multiplication  of  (36)  by  z^  leads,  via  (35),  to 

(37)  0  ■  z\zho  +  z^Mz*1)  i  ■  1 . . 

from  which  we  conclude 

THEOREM  4:  Termination  in  a  ray  implies  there  exists  a  nonzero 
nonnegative  vector  z 1  such  that 

(38)  zJ(Mzh)i^.O  i-1 . . 

At  this  juncture,  two  large  classes  of  matrices  M  will  be 
considered.  For  the  first  class,  we  show  that  termination  in  a  ray 
implies  the  inconsistency  of  the  system  (1).  For  the  second  class, 
we  will  show  that  termination  in  a  ray  cannot  occur,  so  that  for  this 
class  of  matrices,  (1),  (2)  always  has  a  solution  regardless  of 

what  q  is. 

The  first  class  mentioned  above  was  introduced  by  Lemke  [16] . 
These  matrices,  which  we  shall  refer  to  as  copositive  plus,  are 
required  to  satisfy  the  two  conditions. 

(39)  uMu  0  for  all  u  >_  0 
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(AO) 


(M  +  M^)u  «0  if  uMu  -  0  and  u  0 

Matrices  satisfying  conditions  (39)  alone  are  known  in  the 
literature  as  copositive  (see  [18],  [12].)  To  our  knowledge,  there 

is  no  reference  other  than  on  copositive  matrices 

satisfying  the  condition  (AO).  However,  the  class  of  such 
matrices  is  large  and  includes 

(i)  all  strictly  copositive  matrices,  i.e.  those 
for  which  uMu  0  when  0)lu>0 
(ii)  all  positive  semi-definite  matrices,  i.e.  those 
for  which  uMu  0  for  all  u. 

Positive  matrices  are  obviously  strictly  copositive  while  positive 
definite  matrices  are  both  positive  semi-definite  and  strictly 
copositive.  Furthermore,  it  is  possible  to  "build"  matrices 
satisfying  (39)  and  (AO)  out  of  smaller  ones.  For  example,  if 
and  are  matrices  satisfying  (39)  and  (AO)  then  so  is  the 
block-diagonal  matrix 

Mi  0  \ 

M  - 

o  m2' 

Moreover,  if  M  satisfies  (39)  and  (AO)  and  S  is  any  skew- 
symmetric  matrix  (of  its  order),  then  M  +  S  satisfies  (39)  and 
(AO).  Consequently,  block  matrices  such  as 
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\  A  M 2j 


satisfy  (39)  and  (40)  if  and  only  if  and  do  too.  However, 

as  Lemke  [16],  [17]  has  pointed  out,  the  matrices  encountered  in  the 
bimatrix  game  problem  with  A  ■  0  and  B  0  need  not  satisfy  (40) . 
The  Lemke-Howson  iterative  procedure  for  bimatrix  games  was  given 
earlier  in  this  section.  If  applied  to  bimatrix  games,  the 
modification  just  given  always  terminates  in  a  ray  after  just  one 
iteration,  as  can  be  verified  by  taking  any  example. 

The  second  class,  consisting  of  matrices  having  positive  principal 
minors,  has  been  studied  by  numerous  investigators;  see  for  example, 
[2],  [4],  [8],  [9],  [10],  [22],  [24].  In  the  case  of 

symmetric  matrices,  those  with  positive  principal  minors  are  positive 
definite.  But  the  equivalence  breaks  down  in  the  non-symmetric 
situation.  Nonsymmetric  matrices  with  positive  principal  minors  need 
not  be  positive  definite.  For  example,  the  matrix 

'2  -7 1 

-1  4 

has  positive  principal  minors  but  is  indefinite  and  not  copositive. 
However,  positive  definite  matrices  are  a  subset  of  those  with 
positive  principal  minors.  (See,  e.g.  [2].) 
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We  shall  make  use  of  the  fact  that  w  ■  q  +  Mz,  (w;z)  _>  0  has 
no  solution  if  there  exists  a  vector  v  such  that 

(41)  vM  ^  0,  vq  *  0,  v  0 

for  otherwise,  0  vw  -  vq  +  vMz  <  0,  a  contradiction.  Indeed,  it 
is  a  consequence  of  J.  Farkas'  theorem  [7]  that  (1)  has  no 
solution  if  and  only  if  there  exists  a  solution  of  (41). 

THEOREM  5.  Let  M  be  copositive  plus.  If  the  iterative  procedure 
terminates  in  a  ray,  then  (1)  has  no  solution. 

PROOF.  Termination  in  a  ray  means  that  a  basic  feasible  solution 

AAA 

(w  ;z  ,z  )  will  be  reached  at  which  conditions  (32)  -  (34) 
o 

hold  and  also 

/  /  „  h  h  hh^K-h 

(42)  0-zw  *  z  e  z  +  z  Mz 

P  ° 

Since  M  is  copositive  and  z^  _  0,  both  terms  on  the  right  side  of 
(42)  are  nonnegative,  hence  both  are  zero.  The  scalar  ■  0 
because  z  '  0.  The  vanishing  of  the  quadratic  form  zMz  means 

u  h  T  h 

Mz  +  M  z  «  0 

L  u  l  rr  L 

But  by  (32),  zq  ■  0  implies  that  w  ■  Mz  _  0,  whence  M  z  _<_  0 
or,  what  is  the  same  thing,  z^M  0.  Next,  by  (35), 

*h  *h  *  T  h  h  * 

0  “  z  w  «  z  Mz  »  z  (-M  z  )  ■  -z  Mz 

and  we  obtain  again  by  (35) 
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n  h*  h  h  *  ,  tv*  h  ,  h  * 

0  *  z  w  ■  z  q  +  z  e  z  +  z  Mz  ■  z  q  +  z  e  z 

p  o  n  p  o 

h  h  * 

It  follows  that  z  q  <  0  because  :i  e  z  ->  0.  The  conditions  (1) 

p  o 

are  therefore  inconsistent  because  v  -  z^  satisfies  (41). 
COROLLARY.  If  M  is  strictly  copositive,  the  process  terminates 
in  a  complementary  basic  feasible  solution  of  (31). 

PROOF.  If  not,  the  proof  of  theorem  5  would  imply  the  existence  of  a 
h  h  h 

vector  z  satisfying  zmz  *0,  0  +  zn  0  which  contradicts 

the  strict  copositivity  of  M. 

This  corollary  clearly  generalizes  Theorem  1.  We  now  turn  to 
the  matrices  M  having  positive  principal  minors. 

THEOREM  6.  If  M  has  positive  principal  minors,  the  process 
terminates  in  a  complementary  basic  solution  of  (31)  for  any  q. 
PROOF.  We  have  seen  that  termination  in  a  ray  inplies  the  existence 
of  a  nonzero  vector  z*1  satisfying  the  inequalities  (38).  However, 
Gale  and  Nikaido  [10  ,  Theorem  2]  have  shown  that  matrices  with 
positive  principal  minors  are  characterized  by  the  impossibility  of 
this  event.  Hence  termination  in  a  ray  is  not  a  possible  outcome 
for  problems  in  which  M  has  positive  principal  minors. 

We  can  even  improve  upon  this, 

THEOREM  7.  If  M  has  the  property  that  for  each  of  its  principal 
submatrices  M,  the  system 

Mz  _c_  0,  0  j4  z  _  0 

has  no  solution,  then  the  process  terminates  in  a  complementary 
basic  solution  of  (31)  for  any  q. 
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PROOF.  Suppose  the  process  terminates  in  a  ray.  From  the  solution 
(w^jz^.z^)  of  the  homogeneous  system  (32),  define  the  vector 

of  components  of  w*1  for  which  the  corresponding  component 

*  h  h  h 

of  z  +  z  is  positive.  Then  by  (34)  W  *  0.  Let  t  be  the 

vector  of  corresponding  components  in  z*1.  Clearly  0  j*  2^  >_  0, 

h  h 

since  0  4  z  0  and  any  positive  component  of  z  is  a  positive 

h  h 

component  of  z  by  definition  of  w  .  Let  M  be  the  corresponding 
principal  submatrix  of  H.  Since  M  is  a  matrix  of  order  k  1 
we  may  write 

h  h  ,  h 

0  *  w  =  e,  z  +  Mz 
k  o 

Hence 

M2h  _  0,  0  ^  zh  0 

which  is  a  contradiction. 

3.  The  principal  pivoting  method.  We  shall  now  describe  an 
algorithm  proposed  by  the  authors  [4]  which  predates  that  of  Lemke. 
It  evolved  from  a  quadratic  programming  algorithm  of  P.  Wolfe  [26] 
who  was  the  first  to  use  a  type  of  complementary  rule  for  pivot 
choice.  Our  method  is  applicable  to  matrices  M  that  have  positive 
principal  minors  (in  particular  to  positive  definite  matrices) 
and  after  a  minor  modification,  to  positive  semi-definite  matrices. 

In  Lemke's  procedure  for  general  M,  an  artifical  variable  zq 
is  introduced  in  order  to  obtain  feasible  alraost-complementary 
solutions  for  the  augmented  problem.  In  our  approach,  only  variables 
of  the  original  problem  are  used,  but  these  can  take  on  initially 
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negative  as  well  as  non-negative  values. 


A  major  cycle  of  the  algor ithm  is  initiated  with  the  complementary 
basic  solution  (w;z)  *  ( q ; 0 ) -  If  q  _  0,  the  procedure  is  immediately 
terminated.  If  q  J_  0,  we  may  assume  (relabeling  if  necessary) 
that  *=  q^  c  0.  An  almost-complementary  path  ia  generated  by 
increasing  z^,  the  complement  of  the  selected  negative  basic 
variable.  For  points  along  the  path,  z^w^  *  0  for  i  4-  1. 

Step  I.  Increase  z^  until  it  is  blocked  by  a  positive  basic 
variable  decreasing  to  zero  or  by  the  negative  w^  increasing  to 
zero. 

Step  II.  Make  the  blocking  variable  nonbasic  by  pivoting  its 
complement  into  the  basic  set.  The  major  cycle  is  terminated  if 
w^  drops  out  of  the  basic  set  of  variables.  Otherwise,  return 
to  Step  I. 

It  will  be  shown  that  during  a  major  cycle  w^  increases  to 
zero.  At  this  point,  a  new  complementary  basic  solution  is  obtained. 
However,  the  number  of  basic  variables  with  negative  values  is  at 
least  one  less  than  at  the  beginning  of  the  major  cycle.  Since  there 
are  at  most  p  negative  basic  variables,  no  more  than  p  major 
cycles  are  required  to  obtain  a  complementary  feasible  solution  of 
(22).  The  proof  depends  on  certain  properties  of  matrices  invariant 
under  principal  pivoting. 

Principal  pivot  transform  of  a  matrix.  Consider  the  homogeneous 
system  v  *  Mu  where  M  is  a  square  matrix.  Here  the  variables 
v^,...,v  are  basic  and  expressed  in  terms  of  the  nonbasic  variables 


u^,...,Up.  Let  any  subset  of  the  be  made  nonbasic  and  the 

corresponding  basic.  Relable  the  full  set  of  basic  variables 

v  and  the  corresponding  nonbasic  variables  u.  Let  v  -  Mu 
express  the  new  basic  variables  v  in  terms  of  the  nonbasic  ones. 

The  matrix  M  is  called  a  principal  pivot  transform  of  M.  Of 
course,  this  transformation  can  be  carried  out  only  if  the  principal 
submatrix  of  M  corresponding  to  the  set  of  variables  and 

interchanged  is  nonsingular,  and  this  will  be  assumed  whenever 
the  term  is  used. 

THEOREM  8.  (Tucker  [24]).  If  a  square  matrix  M  has  positive 
principal  minors,  so  does  every  principal  pivot  transform  of  M. 

The  proof  of  this  theorem  is  easily  obtained  inductively  by 
exchanging  the  roles  of  one  complementary  pair  and  evaluating  the 
resulting  principal  minors  in  terms  of  those  of  M. 

THEOREM  9.  If  a  matrix  M  is  positive  definite  or  positive  semi- 
definite  so  is  every  principal  pivot  transform  of  M. 

PROOF.  The  original  proof  given  by  the  authors  was  along  the 
lines  of  that  for  the  preceding  theorem.  P.  Wolfe  has  suggested  the 
following  elegant  proof.  Consider  v  ■  Mu.  After  the  principal 
pivot  transformation,  let  v  -  Mu,  where  u  is  the  new  set  of 
nonbasic  variables.  We  wish  to  show  that  uMu  ■  uv  ■»  0  if 
uMu  ■  uv  '0.  If  M  is  positive  definite,  the  latter  is  true  if 
u  ^  0,  and  the  former  must  hold  because  every  pair  (u^*v^)  is 
identical  with  (u^,v^)  except  possibly  in  reverse  order.  Hence 
JujV^  ■  O'  The  proof  in  the  semi-definite  case  replaces  the 
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"ll  '  °>  m22  ’  °-  "33  '  0 

Suppose  furthermore  that  some  is  negative,  say  <  0.  Then 

the  solution  (w;z)  -  is  complementary,  but  not 

feasible  because  a  particular  variable,  in  this  case  w^,  which 
we  refer  to  as  distinguished  is  negative.  We  now  initiate  an  almost- 
complementary  path  by  increasing  the  complement  of  the  distinguished 
variable,  in  this  case  z^,  which  we  call  the  driving  variable. 
Adjusting  the  basic  variables,  we  have 

(wjz)1  -  (qx  +  m11z1,  q2  +  m^z^  q3  +  m^z^O.O.O) 

Note  that  the  distinguished  variable  w^  increases  strictly  with 
the  increase  of  the  driving  variable  z^  because  >  0. 

Assuming  nondegeneracy,  we  can  increase  z^  by  a  positive  amount 
before  it  is  blocked  either  by  w^  reaching  zero  or  by  a  basic 
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variable  Chat  was  positive  and  is  now  turning  negative. 

A 

In  the  former  case,  for  some  positive  value  z^  of  the 

A 

driving  variable  z^»  we  have  w^  -  +  m^z^  ■  0.  The  solution 

2  A  A 

(w;z)  -  (0,q2  +  m21z1,  q3  +  m^z^  0,0,0) 

is  complementary  and  has  one  less  negative  component.  Pivoting  on 
m^,  replaces  w^  by  z^  as  a  basic  variable.  By  Theorem  8,  the 
matrix  M  in  the  new  canonical  system  relabeled  w  ■  q  +  Mz 
has  positive  principal  minors,  allowing  the  entire  major  cycle  to  be 
repeated. 

In  the  latter  case,  we  have  some  other  basic  variable,  say 

A 

w2  -  q2  +  m2izi  blocking  when  z^  -  z^  >  0.  Then  clearly 
m23  <  0  and  q2  *  0.  In  this  case, 

2  a  A  A 

(w;z)  -  (m11z1  +  qx , 0,  +  q^z^O.O) 

THEOREM  10.  If  the  driving  variable  is  blocked  by  a  basic  variable 
other  than  its  complement,  a  principal  pivot  exchanging  the 
blocking  variable  with  its  complement  will  permit  the  further  increase 
of  the  driving  variable. 

PROOF:  Pivoting  on  m22  generates  the  canonical  system 

wl  "  ql+  mllzl  +  m12w2  +  m13Z3 

z2  q2  +  m21Zl  +  m22W2  +  m23Z3 

w3  “  q3  +  m31Zl  +  m32w2  +  m33Z3 
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The  solution  (w;z)  must  satisfy  the  above  since  it  is  an 

a 

equivalent  system.  Therefore  setting  z  -  z ;  ,w  ■  0,  *3  ■  0 

yields 

2  *  _  a  a 

(w;z)  -  (qx  +  n>11*1.  0,  q3  +  m^z^  z^O.O) 

i.e.,  the  same  almost-complementary  solution.  Increasing  z^ 
a 

beyond  z^  yields 


(qx  +  in11z1.  0,  q3  +  m^z^Zj.O.O) 

which  is  also  almost-complementary.  The  sign  of  m^^  is  the 

reverse  of  m21,  since  m21  “_m21^m22  Hence  Z2  Increases 

a 

with  increasing  -  z^  ;  i.e.,  the  new  basic  variable  replacing 
w2  is  not  blocking.  Since  M  has  positive  principal  minors, 

a 

"  0.  Hence  w^  continues  to  increase  with  increasing  z^  >  z^  . 

THEOREM  11.  The  number  of  iterations  within  a  major  cycle  is  finite. 

PROOF:  There  are  only  finitely  many  possible  bases.  No  basis 

can  be  repeated  with  a  larger  value  of  z^.  To  see  this,  suppose  It 
**  a 

did  for  z^  '  z^  .  This  would  imply  that  some  component  of  the 

a 

solution  turns  negative  at  z^  -  z^  and  yet  is  nonnegative  when 
aa 

zl  m  zl  •  Since  the  value  of  a  component  is  linear  in  z^  we  nave 
a  contradiction. 

Paraphrase  of  the  principal  pivoting  method.  Along  the  almost- 
complementary  path  there  is  only  one  degree  of  freedom.  In  the  proof 
of  the  validity  of  the  algorithm,  z^  was  increasing  and  z^  was 
shown  to  increase.  The  same  class  of  solutions  can  be  generated 
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by  regarding  z^  as  Che  driving  variable  and  Che  ocher  variables 
as  adjusCing.  Hence  wichln  each  major  cycle,  Che  same  almosC- 
complemenCary  pach  can  be  generaCed  as  follows.  The  firsC  edge 
is  obcained  by  using  Che  complemenC  of  Che  disclngulshed  variable 
as  Che  driving  variable.  As  soon  as  Che  driving  variable  is 
blocked,  Che  following  seeps  are  iceraced: 

a)  replace  Che  blocking  variable  by  Che  driving  variable  and 
CerminaCe  Che  major  cycle  if  Che  blocking  variable  is 
disclngulshed;  if  Che  blocking  variable  is  noC 
distinguished. 

b)  let  the  complement  of  the  blocking  variable  be  the  new 
driving  variable  and  increase  it  until  a  new  blocking 
variable  is  identified;  return  to  a). 

The  paraphrase  form  is  used  in  practice. 

THEOREM  12.  The  principal  pivoting  method  terminates  in  a  solution 
of  (1),  (2)  if  M  has  positive  principal  minors  (and,  in 

particular,  if  M  is  positive  definite). 

PROOF.  We  have  shown  that  the  completion  of  a  major  cycle  occurs 
in  a  finite  number  of  steps,  and  each  one  reduces  the  total  number  of 
variables  with  negative  values.  Hence  in  a  finite  number  of  steps, 
this  total  is  reduced  to  zero  and  a  solution  of  the  fundamental 
problem  (1),  (2)  is  obtained.  Since  a  positive  definite  matrix 

has  positive  principal  minors,  the  method  applies  to  such  matrices. 

As  indicated  earlier,  the  positive  semidefinite  case  can  be 
handled  by  using  the  paraphrase  form  of  the  algorithm  with  a  minor 
modification.  The  reader  will  find  details  in  [A]. 
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